Scope: open-source tools for AI crawlers, browser agents, deep research agents, and agent orchestration platforms. Every score is computed by versioned code (open_source_ai_tools_v1) from GitHub activity, stars, and license — never by subjective model judgment.
AI Crawlers (5 items)
Crawling tools that use semantic models to understand pages, generate or repair extraction rules, or convert web pages into LLM-usable formats.
- 9.68
- 9.36
- 8.79
- 7.3
-
#5 ai-web-research5.0Deterministic, LLM-independent robots/sitemap-aware crawler producing LLM-ready Markdown with a resumable frontier
Agent Orchestration Platforms (2 items)
Platforms providing scheduling, skills, multi-agent routing, and long-running control planes.
- 9.0
- 8.08
Browser Agents (4 items)
AI-driven automation tools that autonomously decide browser interactions — clicking, typing, scrolling, navigating.
- 9.95
- 9.44
- 8.26
- 6.89
Crawler Frameworks (1 items)
Frameworks providing deterministic crawling infrastructure — URL frontier, retry, rate limiting, session management.
- 9.94
Deep Research Agents (4 items)
Research agents that automatically search, read, cross-verify multiple sources, and generate cited reports.
- 9.97
- 9.62
- 8.75
- 7.07